arXiv:1506.07163vl [q-fin.MF] 23Jun2015 


Market shape formation, statistical equilibrium 
and neutral evolution theory 

Sergey Sosnovskiy 

ssnv.skyOgmail.com 

June 24, 2015 


Abstract 

Mathematical methods of population genetics and framework of exchangeability provide a Markov chain 
model for analysis and interpretation of stochastic behaviour of equity markets, explaining, in particular, market 
shape formation, statistical equilibrium and temporal stability of market weights. 


1 Introduction 

Log-log plot of normalized stock market capitalizations ranked in descending order is called capital distribution 
curve. For example, figures below display distribution of capital on the NASDAQ market on three dates in 
2014 (data source is http://www.google.eom/fincLnce#stockscreener). Ranked market weights experienced 
relatively small fluctuations, despite significant changes in overall capitalization of the NASDAQ market during 
that period of time. 




Figure 1: NASDAQ capital distribution curves, all stocks (above) and top 100 stocks (below) 
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One of the aims of this paper is to provide an example of a possible mechanism explaining temporal stability 
and statistical equilibrium of normalized stock capitalizations by means of the Polya-Dirichlet Markov chain, 
analogous to the Wright-Fisher model of neutral theory of evolution. 

Classic and neutral evolution theory. Classic form of Darwinian theory suggests that forces of natural 
selection play central role in evolution of species. Theory of neutral evolution, proposed by Kimura, complements 
the classic theory by adding genetic dimension. Kimura observed that discrepancies in traits, such as small 
variations in colouring of beaks or feathers in a population of birds, occur at molecular-genetic level due to 
random effects in reproduction and majority of these variations are neutral with respect to fitness. According to 
the neutral theory, force of natural selection is still be important since it purges deleterious mutations. However, 
majority of surviving mutations are neutral, and possibly only few are advantageous. 

Mutations and random combinations of genes in new generations lead to fluctuations of allelic frequencies 
or genetic drift. The Wright-Fisher and Moran models describe stochastic evolution of genetic frequencies as 
statistical equilibrium fluctuations, modelled by diffusion process with stationary Dirichlet distribution. 

Evolution theory and finance. Application of evolutionary ideas in finance has a long history dating back 
to Malthus, Marshall and many others. Recently Evstigneev, Hens, and Schenk-Hoppe |4] developed descriptive 
model of Evolutionary Finance, which employs principle of natural selection for modeling dynamics of asset 
prices and analysis of investment strategies. 

Kirman m considered version of the Wright-Fisher model with mutation in a context of economic interpre¬ 
tation of behavior of ants searching for a food source. He observed that proportion of ants choosing one of the 
possible food channels is better described by stationary distribution of a Markov chain, rather than by single 
point of equilibrium. He proposed that the ’herding’ behaviour on financial markets as well is better described 
by means of stochastic equilibrium, rather than by single or multiple equilibria. 

Formation of market limit shape. Standard and non-linear versions of the Polya process have been used 
by Arthur et al. [1] for illustration of appearance of market structure. Polya scheme has the following interesting 
property: proportions of balls converge to some limiting values, but these limits are random and described by 
the Dirichlet distribution. 

Markov lattice and reversibility. Polya-Dirichlet Markov chain with state space defined on lattice of 
ordered integer partitions provides a framework for analysis and modeling of stochastic equilibrium of market 
weights. Transitions on the lattice of partitions are described in terms of random up- and dn- operators proposed 
by Kerov [13], FulmanjS], Borodin and Olshanski [5] and Petrov m- Historically, Markov chains with dn/up- 
transitions in a context of Polya model were first studied by Costantini, Garibaldi, et al. in 13], 0. 

Exchangeability and random fluctuations. Infinite exchangeability implies existence of UP- and dn- 
random transitions, connecting adjacent levels of integer compositions. It is shown in Sectionj^that probabilities 
of these transitions satisfy reversibility conditions and therefore induce a lattice of Markov chains. Random 
transitions on this lattice correspond to statistical equilibrium behaviour of market weights or allelic frequencies 
not only for fixed, but also for varying market or population sizes. 

Neutral theory and flnancial markets. The Polya-Dirichlet Markov lattice corresponds to the discrete 
version of the Wright-Fisher process with mutations and provides a toy model of equilibrium markets behaviour. 

• After initial phase of rapid expansion, in a same way as proportions of balls converge to random limits in 
Polya scheme, market weights settle down and form capital distribution curve. 

• Up- and down- changes in overall market capitalization lead to random drift of market weights fluctuating 
in stochastic equilibrium around limiting values, given by the capital distribution curve. The stationary 
distribution of market weights can be modeled by means of the UP- and dn- Markov chain. 

• In general, increase of market capitalization enforces market structure and decrease of capitalization leads 
to weakening of the structure and higher volatility, which creates an opportunity for market reshaping. 
This mechanism is analogous to the so-called nearly neutral theory of evolution proposed by Ohta |15j , in 
which smaller populations have faster molecular-genetic evolution and adaptation rate. 

• This theory provides interpretation of market crises as markets self-adaption to changing economic condi¬ 
tions, where capitalization decrease leads to market reshaping and faster adjustment to new econo-financial 
landscape. 

• Arbitrage opportunities can be considered as corresponding to deleterious mutations, eliminated by forces 
of natural selection. 
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Mechanics, economics and reversible equilibrium. As pointed out by Garibaldi and Scalas m. 
equilibrium modeling in economics and finance was developed under strong influence of ideas of static or classical 
mechanics. Alternative approach is provided by framework of stochastic equilibrium and reversibility conditions, 
which have roots in Boltzmann’s work on statistical mechanics. Exhaustive treatment of econophysics from the 
point of view of exchangeability is contained in the book of Garibaldi and Scalas m- 

Excellent explanation of the framework of reversible equilibrium is contained in the classic book of Kelly [T^] . 


2 Polya process with down/up transitions 

In a classic form of Polya process colored balls are placed into a box with probabilities proportional to weights of 
balls of existing colors. The process provides a discrete counterpart of the Dirichlet distribution, since if vector 
(ai,am) represents initial/prior weights of balls of each color, limiting values of proportions of weights in 
Polya scheme have Dirichlet distribution with the same vector of parameters 'Dm{ai ,..., am)- 
Modified Polya process, in which balls can also be removed illustrates important ideas of 

• appearance and temporal stability of ranked proportions, and 

• stochastic equilibrium of these weights. 

Let us consider an artificial stock market with finite number of stocks represented by m different colours. Initially 
in the box there are m ’prior’ balls of each colour and the same weight a, such that total weight of all balls 
is 6 = ma. In other words, all stocks start with the same initial conditions and colours (or tickers) are used 
only to distinguish the stocks. Vector n = (ni,... ,nm) represents stock capitalizations equal to number of 
placed balls of each color at stage n = ni + ... + nm, so at initial stage this vector is n = (0, ...,0). All possible 
market configurations with overall capitalization n are represented by compositions (ordered partitions) in the 
integer-valued simplex 

Cn = {n = («i, nm) I ni G Nq, Y.ni=n] 

At the first step one of the prior balls is drawn with probability ajQ = Ijm. The ball is placed back into the 
box together with a ball of the same color and unit weight. At stage n probability to add a ball of color i is 


p = 


a + Ui 


e- 


n 


where Ui denotes number of balls of color i in the box. For instance, with m = 3 colors, say red, green and blue, 
probability of drawing 3 red balls, 2 green ones and 1 blue ball in this particular sequence is 


pCrrrggb') = 


>f(a-I-1 )(q;-I-2) a{a + \) a 


0[6] 


e{e + i){e + 2 ) (0 + 3)(0 + 4) d + 5 

with raising or ascending factorial power defined as 

aW = a(a + 1) • • • (a + fc - 1) = 

r(a) 

By combinatorial argument probability of configuration n = (ni, ...,nm) at stage n is 


p(n) = 


Uti 


vKl r?! 


ni,...,nmj dM m! 


( 1 ) 


For each level n this formula establishes probability distribution in the simplex C„, moreover this distribution 
is exchangeable or symmetric, in a sense that probability of any sequence does not depend on the order of balls 
drawn and depends only on the number of balls of each color. 

Using asymptotic ^ 


r(6») 


p(n) 


r(0) 




\ n / 

\n) 


n® 1 r(a;) r(a) (r(a))™ 

which corresponds to density of symmetric Dirichlet distribution faix) da: = dxi • • • dxm-i 


3 
















UP- and DN- transitions. In a standard Polya model number of balls increases at each stage, such that in 
configuration n = (ni,..., Um) G Cn component i increases by one with conditional probability 


Ll2,n 


a + rii 
0 + n 


( 2 ) 


This can be considered as random UP-transitions of configuration from simplex to C„+i. In financial terms, 
UP-moves correspond to investment into particular stock and increase of capitalization. Clearly, stochastic 
dynamics of these transitions is of preferential attachment type, since conditional probability ([^ of stock growth 
is proportional to its capitalization rii. As shown below up- moves preserve probability distributions Q on 
simplexes C„. 

It turns out, that UP-moves also implicitly define DN-transitions, which randomly move configuration back¬ 
wards from simplex to C„_i. These DN-transitions also preserve probability structure on simplexes. In 
terms of Polya’s model DN-move corresponds to removing a ball of some color at random and financially it has 
interpretation of decrease of capitalization of one of the stocks by one unit. 

Structure of exchangeable probability distribution plays an important role connecting up- and DN- transitions, 
dual to each other. For the sake of illustration let us consider case of two stocks, labelled by two colours. Structure 
of connections of probabilities between simplexes Co,Ci,C 2 ,... with m = 2 is shown below, where Pk,n-k denotes 
probability of configuration with k balls of the first color and n — k balls of the second color. 


Po.o 



P2,0 



Pi.i 


Po.2 


Let us consider probability flows between levels C„-i and for ni + n 2 = n 


Pni,n2 — 1 


Pni — l,n2 


Pn\ + l,n2 — l 



Pni ,712 


Ptii —1,712-1-1 


For instance, configuration (ni,n 2 — I) can migrate to state (ni -I- I,n 2 — 1) with probability or go to 

state (ui,n 2 ) with probability thus contribution or forward probability flow to configuration ( 111 , 712 ) is 


pf( 


Til ,772 — 1 )—>■ (tIi ,772 ) 


P77i,772 —1 


a -I- 712 — I 
0-1-71—1 


Similarly it can be shown that probability flow from state (tii — 1 ,712) to state (ni, 772) is 

_ a -I- Til — I 

PU 77 i- 1 , 772 )- 7 ( 77 i, 772 ) ~ ^ 771 - 1,772 g _j_ ^ 

It is easy to see that UP-moves preserve probability measure Q on simplexes. For instance, total flow of 
probabilities into state (711,712) is 

777— 1 \ Q;I 77 i]q, [ 772 - 1 ] ^ 0 + 772—1 t ^ t Q ^77 1 " 1 ] q, [t^ 2 1 ^ 0 + 771—1 _ { -L ( 0 ^ 771 ]q,[ 772 ] _ ( ^ ^ Q^ 771 ]q[ 772 ] 

\ ni y 0[”'—1] 0+n—1 ' Wi —1/ — 9-\-n—l \\ ni / \ni,n 2 / 


In other words, fraction („^”„ 2 ^_i) j {n^n 2 ) “ ^ probability Pni,n 2 comes from configuration ( 711,712 — I) and 
fraction / {.n^n^ = ^ comes from configuration (711 — 1 , 712 ). This means that given probability of 

state Pni,n 2 backward probability flow can be interpreted as random removal of one of the balls with p = rii/n: 


(771,772-1) ^ 


(711-1,772) 


( 711 , 712 ) 
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In general, random DOWN-transition moves configuration n = (ni, rim) from simplex C„ to C„_i, and in terms 
of Polya model it removes a ball of color i with probability 


, _ ^ 
Qf.n — 

n 


(3) 


It is straightforward to show that DN-moves also preserve probability measure Q. In terms of artificial market 
model UP- and dn- transitions correspond to increase and decrease of capitalization (buying/selling) of a stock 
by one unit of money. 


3 Market shape formation 

Classic Polya scheme (with UP-transitions) provides a model for simulation of market growth. It turns out that 
in this model, even if initial conditions are the same for all stocks, over certain period of time, or after reaching 
certain market capitalization, power-law shaped market structure begins to appear. 

Figures below illustrate shape formation of the capital distribution curve on the artificial market. Left side 
of figures contains realization of market weights, modeled by UP-transitions and right side displays log-log plot 
of ranked weights at the terminal stage. All stocks have the same initial conditions modeled by equal prior a. 
After rapid period of ’Big Bang’-like chaotic expansion, market weights begin to settle down and after step 1500 
do not change significantly. 


market weights evolution capital distribution curve 



0 500 1000 1500 2000 1 e+0 1e+1 1e+2 

Figure 2: Dynamics of market weights and capital distribution, 20 stocks {a = 5,9 = 100) 

Next figure illustrates that for smaller values of parameter a there is greater variation of market weights. 
Particular choice of parameter a = 1 corresponds to the uniform stick-breaking niche model. 


market weights evolution 


capital distribution curve 



Figure 3: Dynamics of market weights and capital distribution, 20 stocks (a = 1,6 = 20) 
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4 Statistical equilibrium and Polya-Dirichlet Markov process 

One of the central ideas of neutral evolution theory is that proportions of genes in a population (allelic frequen¬ 
cies) experience random drift, in other words they fluctuate around some values. It is important that population 
size may increase or decrease (in reasonable amounts), but allelic frequencies remain approximately the same. 
The same phenomenon is observed on financial markets: ranked equity capitalizations, comprising capital dis¬ 
tribution curve display remarkable temporal stability, despite significant fluctuations of overall capitalization. 

Wright-Fisher model (WF) and its generalizations provide a framework for modeling evolution of proportions 
of genes fluctuating in stochastic equilibrium. Finite form of the m-allele WF-model is based on a Markov chain 
with state space of ordered integer partitions (compositions) with m elements. Since stationary distribution of 
proportions in limiting case of the WF-model with mutation is given by Dirichlet distribution, for consistency 
it is assumed that finite version of WF-model is approximated by the Polya distribution Q. 

In Polya model with DN/uP-transitions ordered partition n = (ni,..., Um) may represent: 

• vector of stock capitalizations with overall market capitalization n, 

• number of genes of each specific type in a population of size n. 

As above it is assumed that vector of priors (or mutation rates, correspondingly), is a symmetric vector with 
all components equal to a and 9 = ma denotes sum of all parameters. Stationary distribution with transitions 
in integer simplex can be constructed by combining DN- and UP-transitions, as proposed in and 

[9]. For instance, transition where one item moves from category i to category j in DN/uP-scheme, is modeled 
in two steps. 

(.., .., Uj ,..) I ^ I;--5 nj ,..) I ^ I;”; nj -t- I,..) 

with probability qi^j = for i j, and with qi^i = as probability of return. 

Reversibility and stochastic equilibrium. 

Ifg(a b) denotes conditional probability of migration from state a to state b, then reversibility (detailed 
balance) conditions imply for all states in state space S 

p(a)(7(a b) = p(b)q(b a), Va,beiS (4) 


Besides time-reversibility, there are some other interesting interpretations of detailed balance conditions. 


• In mechanical systems if each process is matched by its reverse process, then the system is in equilibrium. 
Equilibrium may take place on a micro-level, while on a macro-level the system may stand still. 

• In terms of probability flows, essentially Q states that unconditional probability flow from a to b must 
be equal to probability flow from state b to state a. 


It is easy to show that both DN/up- and up/dn- schemes satisfy detailed balance conditions and therefore 
they induce reversible and hence stationary Markov chain with a state space of ordered partitions for each n. 

More detailed analysis reveals that reversibility conditions connect probability distributions on all adjacent 
simplexes Cn-i and 



For instance, probability flows between compositions (ni — I,n 2 ) and (ni,n 2 ) satisfy 


(n—l)!a["i — i ^ q, q;["i]q:["2] 

(ni — l)!n 2 ! n + 9 — 1 0H ni\n 2 \ n’ 

which also clarifies role of UP- and dn- operators. In other words, probability distributions Q on simplexes 
are pairwise connected. Since for sufficiently large n Polya distribution approximates Dirichlet distribution, 
sequences of UP- and DN-operators between simplexes approximate equilibrium process with stationary Dirichlet 
distribution even with changing values of n. 
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This provides a framework for modeling evolution of market weights for fixed and variables values of n. It 
turns out that behavior of equilibrium process depends on the population size. When overall market capitaliza¬ 
tion is sufficiently large market structure becomes enforced. In contrast, decrease of market cap leads to higher 
variations of market weights. 

For instance, figures below illustrate two phases of evolution of market weights. During the first phase, 
for t ^ 500 (Figure 5) or t ^ 1500 (Figure 6), the market experiences period of growth and formation of 
limiting weights, representing capital distribution curve, displayed on the right subplots with blue circles. Once 
market value reaches threshold value of n = 500 or n = 1500 market capitalization begin fluctuating in dn/up- 
transitions, which generates stochastic evolution of market weights. Corresponding capital distribution curve at 
the terminal period is shown with red circles. As it can be seen from the figures, stocks with larger capitalizations 
have higher trading activity. 


market weights evolution 


capital distribution curve 


0.25 


0.2 


0.15 


0.1 


0.05 


0 



Figure 4: Fluctuations at level n = 500 begin at t = 500, {a = 1,9 = 20), 20 stocks 



Figure 5: Fluctuations at level n = 1500 begin at t = 1500, {a = 1,9 = 20), 20 stocks 


Such behavior of weights, dependent on level n is consistent with the so-called ’nearly neutral theory’, de¬ 
veloped by Ohta where it is proposed that smaller populations experience faster rate of genetic evolution. 

In financial terms, it suggests the market crises can be ’explained’ as markets self-adaption to changing eco¬ 
nomic conditions, where reduced market capitalization allows faster reshaping and adjustment of capitalization 
structure to new econo-financial landscape. 
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